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CHARACTERIZING MARKOV EQUIVALENCE CLASSES 
FOR AMP CHAIN GRAPH MODELS 1 

By Steen A. Andersson and Michael D. Perlman 

Indiana University and University of Washington 

Chain graphs (CG) (= adicyclic graphs) use undirected and di- 
rected edges to represent both structural and associative dependences. 
Like acyclic directed graphs (ADGs), the CG associated with a sta- 
tistical Markov model may not be unique, so CGs fall into Markov 
equivalence classes, which may be superexponentially large, leading 
to unidentifiability and computational inefficiency in model search 
and selection. It is shown here that, under the Andersson-Madigan- 
Perlman (AMP) interpretation of a CG, each Markov-equivalence 
class can be uniquely represented by a single distinguished CG, the 
AMP essential graph, that is itself simultaneously Markov equivalent 
to all CGs in the AMP Markov equivalence class. A complete char- 
acterization of AMP essential graphs is obtained. Like the essential 
graph previously introduced for ADGs, the AMP essential graph will 
play a fundamental role for inference and model search and selection 
for AMP CG models. 

1. Introduction. In a graphical Markov model, the nodes of the graph 
represent the variables of a multivariate statistical distribution, while the 
edges represent possible dependences. Chain graphs (CG), which may have 
both undirected and directed edges but no semi-directed cycles, were in- 
troduced by Lauritzen and Wermuth [19] and Frydenberg [15] to represent 
dependences that may be both associative and directional. Cox [12] stated 
that chain graphs represent "a minimal level of complexity needed to model 
empirical data." Also see [2, 8, 9, 13, 15, 17, 18, 19, 25, 26, 28, 29]. 

The LWF Markov property for CGs is an extension of the Markov prop- 
erties of both acyclic directed graphs (ADG = DAG) and undirected graphs 
(UG). Recently, Andersson, Madigan and Perlman [1, 4] proposed an alter- 
native Markov property (AMP) for CGs that also extends the ADG and UG 
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properties, but that more closely retains the recursive character of ADG 
models; see [14, 20]. Furthermore, AMP Markov equivalence of CGs (see 
below), as for ADGs, is determined by their triplexes, which have three 
vertices, while LWF Markov equivalence of CGs is determined by their com- 
plexes, which have arbitrarily many vertices. 

Like ADGs, different CGs may be Markov equivalent, that is, may repre- 
sent the same set of conditional independences (CI), hence, the same statis- 
tical models. Because Markov equivalence classes can be superexponentially 
large even for ADGs (cf. [3]), for the sake of computational efficiency, CG 
model search ideally should be carried out in the space of CG Markov equiv- 
alence classes rather than the space of all CGs. 

For any CG G, Frydenberg [15] showed the existence of a unique largest 
(i.e., having the most undirected edges) CG in the LWF Markov equiv- 
alence class containing G. Studeny [23, 24] proposed that G^ be used as 
a unique representative for the LWF equivalence class. Characterizations of 
Gqo have been obtained by Volf and Studeny [27] and Roverato [22]. 

The ADG essential graph D* that uniquely represents the ADG Markov 
equivalence class of an ADG D was introduced by Andersson, Madigan and 
Perlman [3]: D* has the same skeleton as D, and contains an arrow a — > b 
iff this arrow occurs in every member of the equivalence class, whereas it 
contains a line a — b iff a — > b and a^b occur in two different ADGs in the 
equivalence class. Applications of the ADG essential graph for ADG model 
search are presented in [10] and [21]. 

This paper is devoted to the characterization of a unique representative 
of the AMP Markov equivalence class (temporarily denoted by [G]) for a 
general CG G. Andersson, Madigan and Perlman [4] suggested the following 
extension of the definition of the ADG essential graph: the AMP essential 
graph, temporarily denoted by G* , has the same skeleton as G and contains 



G = G* : 





G -G": 




Fig. 1. Two CGs G for which G = G* + G a 
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Fig. 2. An undirected CG G whose essential graph G* contains a directed edge. 



an arrow a — 6 iff this arrow occurs with the same orientation in at least 
one G' € [G], but with the opposite orientation in no G" € [G]. The arrows 
in G* are called essential arrows. For example, if G = a — » b — c, then [G] 
consists of G, G' := a - b <— c, and G" :=a^b^- c, so G* = G" . 

Because G^ is defined for LWF Markov equivalence rather than AMP 
equivalence, it need not agree with G* , even when G = D, an ADG. For 
example, if G is the first CG (an ADG) in Figure 1, then G = G*, but G^ 
replaces one arrow — > by a line — . Similarly, for the second CG G in Figure 1, 
two arrows are replaced by lines in G^- In fact, even if G (and therefore Goo) 
is a fully undirected graph, G* may possess essential arrows — see Figure 2. 

In Section 3 we show that the AMP essential graph G* does in fact 
uniquely represent its AMP Markov equivalence class [G]: G* is itself a 
CG (adicyclic) and G* € [67] (Theorem 3.2). Section 4 completely describes 
the configurations of arrows in G*. It is also shown there that if G is itself 
an ADG D or is AMP Markov equivalent to D, then G* = D* (Proposi- 
tion 4.2), and a characterization of those directed graphs that can occur 
as AMP essential graphs is given (Theorem 4.1). In Section 5 a complete 
characterization is obtained for AMP essential graphs (Theorem 5.1). Ad- 
ditional results on the structure of AMP essential graphs may be found in 
[5, 6]. Current research, including an algorithm for constructing G* from G, 
is reviewed in Section 6. 

2. Graphical terminology. We write G = (V, E) to indicate a graph G 
with vertex set V and edge set E. Definitions of the graphical terminol- 
ogy and notation used here can be found in [3, 4] and especially [5]. The 
terms parent, neighbor, immorality, flag, triplex and biflag are particularly 
important for our study of chain graphs. 

Let a, b be distinct vertices of G. We write a^beG(a^beG) (a - ■ -b £ G) 
to indicate that either a^b^G or a — 6 £ 67 (either a<— b €G or a ^ 6 £ 67) 
(either a <— b 6 G, a — b^G, or a — > b E G). A path ir of length k > 1 from a 
to b in G is a sequence of distinct vertices (a = v^,v\, . . . ,vt = b) such that 
Vi-i Vi G G for all i = 1, . . . ,k. A k-cycle (vo, ■ ■ ■ ,Vk) (or simply cycle) 
in G is a path of length k > 3 with vq = Vk- A path or cycle (vq, . . . ,Vk) is 
undirected if Vi-\ — Vi 6 G for all i = 1, . . . , k; it is directed (semi- directed) 
if v i-\ — > v i S G for all (at least one) i = 1, . . . , k. A chain graph (CG) is an 
adicyclic graph, that is, has no semi-directed cycles. An induced subgraph 
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of an adicyclic graph is adicyclic. The set of chain components of the CG 
G, denoted by S = S(G), is the set of connected components obtained by 
removing all arrows from G. 

A path (cycle) (vq, . . . ,Vk) in G with k > 2 {k > 4) is chordless if no two 
nonconsecutive [nonconsecutive (mod k)] vertices are adjacent. A chordless 
2-dipath in G is an induced subgraph of the form a — > b — > c. An antiflag is 
an induced subgraph of the form a — 6 — > c. 

An undirected graph G is chordal (= decomposable) if it contains no 
chordless cycles. The edges of a chordal UG G = (V, E) can be assigned 
a perfect orientation (i.e., acyclic with no immoralities) by the maximum 
cardinality search (MCS) algorithm (cf. [7], Theorem 2.5, [11], Chapter 4.4). 
MCS begins by assigning the number 1 to an arbitrary vertex of G, then 
assigning the numbers 2, . . . , \ V\ consecutively to the remaining vertices, each 
time selecting the vertex with the most previously numbered neighbors in G, 
breaking ties arbitrarily. The edges of G are then oriented in accordance with 
this numbering. This numbering is called perfect because this orientation can 
be shown to be perfect. Furthermore, if A C V is complete, MCS can begin 
at any v £ A and visit all vertices in A before visiting any vertex in V \ A. 
Thus, any edge a — -u £ G with a £ A and v 6 V \ A can be oriented by MCS 
as a — > v. 

3. The essential graph for an AMP chain graph model. In this paper 
Go = (V,Eq) shall denote a fixed but arbitrary chain graph and Q its AMP 
Markov equivalence class, that is, the collection of all CGs G = (V,E) such 
that V(G) =V(Go), where V(G) is the set of all multivariate probability 
distributions that satisfy the AMP Markov property specified by G. AMP 
Markov equivalence was characterized by Andersson, Madigan and Perlman 
[4] as follows. 

Theorem 3.1. Two chain graphs with the same vertex set are Markov 
equivalent iff they have the same skeleton and the same triplexes. 

We shall show that Q is uniquely represented by its essential graph Q* , 
defined below. To emphasize that the AMP essential graph depends on Q, 
we now denote it by Q* , rather than by Gq as in Section 1. 

Definition 3.1. The AMP essential graph Q* = (V,E*) determined by 
Q is a graph with the same skeleton as Go . An arrow a^b occurs in Q* iff 
a b occurs in at least one G S Q, but a <— b occurs in no G' G Q. A line 
a — b occurs in Q* iff either a — b £ G for every G € Q or there exist G, G' £ 
such that a->6£G and a <— b £ G' . 
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Fig. 3. Strong/weak arrows/lines in AMP essential graphs (cf. Figure 6). 

Thus, the line a — b G Q* iff either: a — b G G for all G G G, in which case 
it is called a strong line and denoted as a - 6, or: a — > b G G and a <— b G G' 
for some G, G' G <5, in which case it is called a u>ea& line and denoted as 
a - b. In these two cases, a is a strong (resp., weak) neighbor of b. An arrow 
a —>b G £?* is called strong and denoted as a A 6 if it occurs in each G G G', 
otherwise it is called weak and denoted as a —>b, in which case 3 G, G' G <5 
such that a^beG and a — 6 G G' , while a =>■ 6 G G" for all other G" G 
In these two cases, a is a strong (resp., weak) parent of 6. The set of strong 
(weak) parents in £?* of a subset .B C V is denoted by spg*(5) [wpg*(B)]. 

In the AMP essential graph a — > 6 <— c, both arrows are weak, while in 
a — b — c both lines are weak. Other examples of strong/weak arrows/lines 
are given in Figures 3, 4 and 7. (Also see [5, 6].) 

The following fact will be used repeatedly. Consider the four statements: 

1. a^beQ*; 

2. a^b£G for all G G Q; 

3. a — > 6 G G for some G €Q; 

4. a^beG*. 

Then 1 implies 2 implies 4 and, equivalently, 1 implies 3 implies 4. 

This section will culminate with Theorem 3.2, which establishes that g* 
is in fact adicyclic so is itself a chain graph. Thus, Q* G g by the following 
Lemma 3.1 and, therefore, g* uniquely represents g: C/i = £2 iff g* = ^2- 

Lemma 3.1. Q* has the same skeleton and triplexes as each G G (y. 



Proof. Clearly, g* has the same skeleton as each G G £/. Suppose that 
the triplex ({a, c}, 6) occurs in each GG^, so a=>6<^=c occurs as an induced 
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(5) (7) ( 8 ) 

Fig. 4. Strong/weak arrows/lines in AMP essential graphs (cf. Figure 6). 

subgraph in each Gg5, hence, also a b <= c occurs as an induced subgraph 
in Q* . Furthermore, there exists G such that either a — > b G G, in which 
case a — ► b G Q*, or b <— c G G, in which case b ^ c^Q* . In both cases, the 
triplex ({a,c},o) occurs in Q* , as required. 

Conversely, suppose that the triplex ({a, c}, 6) occurs in Q* . If this triplex 
occurs as the immorality a — > 6 <— c in (?* , then a =4> 6 •<= c occurs as an 
induced subgraph in each G G Q while a — > 6 G G' for some G' &Q, hence, 
this triplex occurs in G' and thus in all G € £/. 

If this triplex occurs as the flag a — > 6 — c in Q* , then a =4> b G G for every 
G G £/. If 6 — c were a weak line in Q* , then there would exist G,G' £Q such 
that a =^ 6 — > c occurs in G and a=>b <— c occurs in G', both as induced 
subgraphs, contradicting the fact that G and G' have the same triplexes. 
Therefore, b — c must be a strong line in Q* . By a similar argument, a — > b 
must be a strong arrow in Q* and, therefore, a — ► 6 — c occurs as a flag in 
each G G £/. Thus, again the triplex ({a, c}, 6) occurs in each G G £7. □ 



Lemma 3.2. (&) A flag a^b — c occurs in Q* iff it occurs in each G EQ, 
in which case a — > 6 is a strong arrow and b — c is a strong line. Thus, neither 
a — ► b - c nor a A 6 - c can occur as an induced subgraph of Q* . 
(b) • // a — > 6 - c occurs as a subgraph in Q* , then a =4> c G (7* . 

• // a A 6 - c occurs as a subgraph in Q* , then a A c G {?* . 

• If a—> b—> c occurs as a subgraph in Q* , then a—>cEQ*. 

• If a - b - c occurs as a subgraph in Q* , then a - c G C7* . 
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Proof, (a) "Only if" was established in the last paragraph of the proof 
of Lemma 3.1, while "if" is immediate. 

(b) If a — > b — c occurs in Q* , then by (a) a ■ ■ ■ c G Q* and, therefore, a - ■ c 
occurs in all G G Q. Choose G G Q such that b — > c G G. Since necessarily 
a => b G G, therefore, a — ► c G G by adicyclicity, hence a c € (?*. 

If a^b-c occurs in £/* , then by (a) the triangle a =>■ 6 — c • • • a occurs in 
all G GG, hence a c £ G by adicyclicity. If we now choose G,G' GQ such 
that a — > b G G and a — b £ G' , then a — > c € G and a-cGG'by adicyclicity, 
hence a — > c 6 {?*. 

If a — > 6 — > c occurs in £/*, then a — > b =>■ c occurs in every G £ ^ and 
a^b — c occurs in some G" 6 Q. Since Q* and G' have the same triplexes by 
Lemma 3.1, a ■ ■ ■ c G G' , so the triangle a — > 6 =>■ c • • • a occurs in every G G G- 
Thus, a—*c must occur in every G £Q by adicyclicity, hence a — > c € 

If a-b- c occurs in £/* , then there exist G,G' €Q such that a — b — > c oc- 
curs in G and a — b^c occurs in G' . Since G and G' have the same triplexes, 
necessarily a - ■ • c 6 G,G' , hence a->c£G and a <— c G G' by adicyclicity. 
Therefore, a - c G ^* . □ 

Lemma 3.3. A biflag or chordless undirected cycle occurs in Q* iff it 
occurs in at least one G G Q, in which case it occurs in all G G Thus, if 
an arrow occurs in a biflag in Q* or some G G Q, then it must be strong, 
while if a line occurs in some biflag or chordless undirected cycle in Q* or 
in some G GQ, then it must be strong. 

Proof. If a biflag [a; c±, . . . , Ck] (k>3) or [a, b; c\, . . . , C&] (k > 2) oc- 
curs in Q* , then, because - - cannot occur as an induced subgraph in Q* 
[Lemma 3.2(b)], either all undirected edges c, — q+i (1 < i < k) are strong 
or all are weak. Since the flag a A Ck-i -c^ occurs in Q* , therefore all edges 
Cj — Cj+i are strong. Furthermore, if any arrow a — > Cj or b — > Ci is weak, then 
all must be weak [apply Lemma 3.2(b)], a contradiction. Thus, all arrows 
and lines occurring in the biflag are strong, hence the biflag occurs in every 
GGQ. 

Conversely, if a biflag [a; c±, . . . , Ck] or [a, b; c±, . . . , Ck] occurs in some G GQ, 
then the triplex ({a, c/c}, Ck-i) occurs in Q* . If this triplex occurs as the flag 
a A Ck-i ~Cfc, then the above argument applies to show that the biflag 
occurs in every G G Q and in Q*. But the triplex cannot occur in either of 
the other two possible configurations: If it did, then c^-i <— GQ* , which 
would require that c\ <— C2 G Q* . (If c\ ^ c<i G Q* , then at least one triplex 
would occur in the path c\ =>■ c% ■ ■ ■ c^-i <— cj~ in Q* , whereas no such triplex 
occurs in G, contradicting Lemma 3.1.) But c\ <— C2 £ Q* , since a — > C2 — c\ 
or b — > C2 — c\ occurs as a flag in G, so ({a, ci}, ci) G Q* or ({6, ci}, C2) G Q* . 
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Next, suppose that a chordless undirected cycle occurs in Q* or in some 
G G £/• Because no triplex occurs in this cycle, none can occur in the cor- 
responding subgraph in any G' G Q. Therefore, no arrow can occur in this 
subgraph in any G' G Q\ otherwise this subgraph would either include at 
least one triplex or else be a fully directed cycle, contradicting the adicylic- 
ity of G' . Thus, the chordless undirected cycle occurs in every G' € G* and 
each of its lines is a strong line. □ 

The converse to the second statement in Lemma 3.3 is not true: strong 
arrows not occurring in biflags appear in Figures 3(1) and 4(l)-(5). Strong 
lines not in biflags or chordless cycles may also occur; see [5, 6]. 

Lemma 3.4. (a,) Any semi-directed cycle in Q* has at least one weak 
line. 

(b) Ifa^b^d^a is a semi-directed 3-cycle in Q* , then 3G,G' G Q 
such that a =>■ b <— d — > a occurs in G and a => b — > d <— a occurs in G' . Thus, 
the semi-directed 3-cycle must have the form a— >b -d - a in Q* . 

(c) In this case, a — > 6 cannot occur in Q* in an immorality a — > 6 ^ c, 
in a flag a — > b — c, in a chordless 2-dipath c — > a — > b or in an antiflag of 
the form c-a^b. 

PROOF, (a) Let do — > d\ => • • • =>■ (dk = do) (k > 3) be a semi-directed 
fc-cycle in Q* . Then 3G G Q such that do — > d\ G G. Since G is adicyclic, 
d% <— di+i G G for some 1 < i < k — 1, hence d% <= d^i G G* ■ But di => dj+i G 
Q*, so di - di + \ G Q* as required. 

(b) By (a), either b- d E Q* or d - a G G* (or both). If the former, then 
3 G' G G such that b — > d G G'. Since a^b G G' , d <— a G G' by adicyclicity. 
Therefore, d <= a G G* , hence d - a G G* (since d=> a G G* and d <— a G G'), 
so 3 G G <? such that rf->oGG. Since a => 6 G G, 6 ^ <i G G by adicyclicity. 
If the latter, then 3 G G such that d — ► a G G. Since a 6 G G, necessarily 
b^deG by adicyclicity. Thus, b~deG* (since 6 =>- deG*), so 3G' <E G 
such that 6 — > (f G G'. Since a =^ 6 G G' , d <— a G G' by adicyclicity. 

(c) Assume that a^b^= c occurs as an immorality or flag in Let G, G' 
be as specified in (b). Since a-/-c, necessarily c^ d. Because G*,G, G' have the 
same triplexes (Lemma 3.1), b <= c G G, G' . Necessarily d - ■ ■ c, for otherwise 
the triplex ({d, c}, 6) would occur as the induced subgraph d — > & <— c in G 
but this triplex could not occur in G'. Thus, by adicyclicity, d <— c G G', so 
the triplex ({a, c},d) occurs as the immorality a — > <i <— c in G', but this 
triplex cannot occur in G, a contradiction. 

Next, assume that either (i) the chordless 2-dipath c — ► a — > b or (ii) the 
antiflag c-a—>b occurs in Q* . Let G, G' be as specified in (b); again, nec- 
essarily c^d. For both (i) and (ii), necessarily c=^a£G,G'. Therefore, 
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c---d, for otherwise the triplex ({c, d},a) would occur as the induced sub- 
graph c =>■ a <— d in G, but this triplex could not occur in G . Thus, by 
adicyclicity, c — > d £ G, so the triplex ({c,b},d) occurs as the immorality 
c — ► d <— 6 in G', but this triplex cannot occur in G, a contradiction. □ 

For any graph H = (W,F), define H° = (W,F°) to be the smallest chain 
graph larger than H, that is, H° is obtained from H by converting any 
arrow that occurs in a semi-directed cycle in H into a line. Note that this 
can be done in a single step: if, after converting an arrow that occurs in a 
semi-directed cycle in H into a line, a second arrow now becomes part of a 
semi-directed cycle, then this second arrow already must have occurred in a 
semi-directed cycle in H. Clearly, H° has the same skeleton as H , H C H°, 
and H is adicyclic iff H° = H. 

Lemma 3.5. (a) Q* and {Q*)° have the same immoralities. 

(b) Q* and (Q*)° have the same flags. 

(c) If an antiflag of the form a ~b — ► c occurs Q* , it also occurs in (Q*)° . 

Proof, (a) Since Q* C (Q*)° with the same skeletons, if a — > 6 <— c oc- 
curs as an immorality in then it must occur in Q* . Conversely, sup- 
pose that a — > 6 <— c occurs as an immorality in C?* but not in (Q*)°. This 
can happen only if at least one of the two arrows is converted to a line 
in {Q*)° , hence occurs in some semi-directed cycle in Q* . Choose the im- 
morality a — > 6 <— c i/iai is associated with a semi-directed cycle of minimum 
length k [i.e., minimal with respect to all immoralities a' — > 6' <— c' in £/* 
that do not occur in (G*)°] and assume without loss of generality that this 
minimum-length semi-directed cycle contains a — ► b. This cycle thus has the 
form a —>■ (b = di) ^ d 2 ^ ■ ■ ■ ^ (d k = a) in Q*. By Lemma 3.4(c), k > 4. 

It is conceivable that d{ = c for some (at most one) i = 3, . . . , k — 2. In 
that case, however, {di = c) — ► 6 occurs in a shorter semi-directed cycle c — ► 
(6 = d\) ■ ■ ■ => (di = c) in Q* , contradicting the minimality of k. Therefore, 
di^c for each i. 

By Lemma 3.4(a), the minimum-length semi-directed cycle has at least 
one weak line dj — c?j+i 6 Q* (1 < j < k — 1). Consider the least such j. 

Suppose first that j > 2. In this case the minimality of j implies that either 
dj-i — > dj - dj + \ or dj_i - dj - occurs in Q*, hence dj-\ ^> € ^* 
by Lemma 3.2(b). Thus, a A (6 = di) =^ ■ • ■ => dj_i =>■ dj+i • • ■ => (dfc = a) 
is a shorter semi-directed cycle in Q*, contradicting the minimality of k. 

Suppose now that j = 1, so (b = d\) - di € Q* . Therefore, a —>b~ di and 
di - b <— c occur as subgraphs in £/*, so by Lemma 3.2(b), a^> di <t= c occurs 
as a subgraph of Q* . If a — di £ G* , then a — > 6 occurs in the semi-directed 
3-cycle a — ► 6 — c?2 — a in contradicting Lemma 3.4(c), hence a ^ di £ G* . 
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Similarly, di <— c £ Q* , hence a — > d,2 <— c occurs as an immorality in Q* . 
But then a — ► d2 occurs in the shorter semi-directed cycle a — > d2 =>■ • • • => 
(dfc = a) in Q* , contradicting the minimality of fc. We conclude that every 
immorality in Q* also occurs in (Q*)° . 

(b) If a flag occurs in Q*, it has the form a A 6 - c by Lemma 3.2(a). 
Because £7* C (Q*)° and they have the same skeletons, if a — > 6 — c does 
not occur as a flag in (£7*)°, then a — b — c must occur in (£?*)° with a-/- c 
in both graphs. This implies that a A b occurs in a semi-directed cycle 
a — > (6 = di) =>■ =^ ■ • • (dfc = a) in £?*. Choose this cycle to minimize k; 
by Lemma 3.4(c), k > 4. 

It is conceivable that di = c for some (at most one) i = 2, . . . , k — 2. If 
such i exists and % > 3, then a (6 = di) — d$ =>■ • • ■ => (d& = a) is a shorter 
semi-directed cycle in £7*, contradicting the minimality of fc. Thus, either 
i = 2 or no such % exists. 

By Lemma 3.4(a), the minimum- length semi-directed cycle must have at 
least one weak line dj - d^+i £Q* (1 < j < k — 1). Consider the least such j. 
If j > 2, then the minimality of k is contradicted exactly as in (a). Suppose, 
therefore, that j = 1, so (b = d\) - d2 € Q* ■ (Also, i does not exist and d2 7^ c.) 
Since now a—>b-d2 and d2 - b - c occur in Q* , a d2 € Q* and d2 - c £ ^* 
by Lemma 3.2(b). However, a — > d2 cannot occur in t/* [otherwise a — > d2 - c 
would be a flag in £/*, contradicting Lemma 3.2(a)], so a — d2 € Q*. Thus, 
a— >b — d2 — a is a semi-directed 3-cycle in Q* , contrary to Lemma 3.4. 

Conversely, assume that a — > b — c occurs as a flag in (Q*)°, so a — ► 6 ■ • • c 
occurs in Q* . If b — c £ G* , then the flag also occurs in Q* , as asserted. If 
b<— c£Q* , then o — ► 6 <— c occurs as an immorality in t/*, hence by part (a) 
also occurs as an immorality in (G*)°, contrary to assumption. 

Thus, assume that a — > 6— > c occurs as a chordless 2-dipath in Q* . Then 
b — > c must occur in a semi-directed cycle 6 — ► (c = di) =>■ d2 =>■ • • • (dfc = 
6) in t/*. [Note that di ^ a for each i; otherwise a — > 6 would be included 
in a semi-directed cycle and would thus be converted to a — b in (£7*)°, 
contradicting the original assumption.] Choose the chordless 2-dipath a — > 
6 — > c in £7* f/iai is associated with a semi-directed cycle having minimal 
length k with respect to all chordless 2-dipaths a' — > b' — > d in Q* that occur 
as a' -> 6' - c in (C7*)°. By Lemma 3.4(c), fc > 4. 

By Lemma 3.4(a), the minimum-length semi-directed cycle must have at 
least one weak line dj — dj+i S£7* (1 < j < k — 1); consider the least such j. If 
j >2, then the minimality of fc is again contradicted exactly as in (a). Thus, 
assume that j = 1, so b — > (c = di) — d2 occurs in £7*. By Lemma 3.2(b), 
b => d2 G £7* • If 6 — d2 € £7* , then 6 — ► c occurs in a semi-directed 3-cycle 
6 — > c - d2 — 6 in C7*, contradicting Lemma 3.4(c), so 6 — > d2 G £7* ■ 

If a-/- d2 in £7*, then the chordless 2-dipath a — > b — > d2 is associated with a 
shorter semi-directed cycle b — > d2 =>■ • • • =>■ (dfc = 6) in Q* , contradicting the 
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minimality of k, hence a ■ ■ -di G Q* . If a <^= d,2 G G* , then a— >b — > c - d,2=? a 
is a semi-directed cycle in Q*, so a — > /3 would be converted to a line in 
(£?*)°, contrary to assumption; thus, a — > d<i £Q*. But then a — > d<i — c is a 
flag in £?*, contradicting Lemma 3.2(a). Thus, a—>b — c also occurs as a flag 
in 0*. 

(c) Suppose that a-b — >c occurs as an antiflag in Q* but not in {Q*)° . 
Then b — > c must occur in a semi-directed cycle 6 — > (c = di) =4> d2 • • • => 
(d& = 6) in £/*. Choose the antiflag a~b^c in Q* that is associated with 
a semi-directed cycle having minimum length k with respect to all antiflags 
a! — V — > c' in C?* £/iai occur as a' — b' — c in (Q*)°. By Lemma 3.4(c), k > 4. 

It is conceivable that di = a for some (at most one) i = 3, . . . , k — 1. If such 
i exists and i < k — 2, then 6 — ► (c = di) =>■■•■=>• d* - (dfc = 6) is a shorter 
semi-directed cycle in £/*, contradicting the minimality of fe. Thus, either 
i = k — 1 or no such i exists. 

By Lemma 3.4(a), the minimum-length semi-directed cycle must have at 

least one weak line dj - d J+ i G <5* (l<j< k — 1); consider the least such j. If 
j > 2, then the minimality of k is again contradicted exactly as in (a). Thus, 

assume that j = 1, so b — > (c = di) — d2 occurs in (/*. By Lemma 3.2(b), 
b d2 G Q* . If 6 — d2 G <?*, then 6 — ► c occurs in a semi-directed 3-cycle 
6 — ► c - d2 — 6 in Q* , contradicting Lemma 3.4(c), so b — > d2 G Q* . 

If a-/- d2 in Q*, then the antiflag a —> b — > d2 is associated with a shorter 
semi-directed cycle 6 — > d2 => • • • =>■ (d& = 6) in £/*, contradicting the min- 
imality of k; hence a ■ ■ ■ d2 G Q*. If a d2 G (?*, then 6^d2=^a-6 is a 
semi-directed 3-cycle in £/*, contradicting Lemma 3.4(b), so a — > d2 G 
But then a — ► d2 - c occurs as a flag in Q*, contradicting Lemma 3.2(a). □ 

Two vertices a, a' G V are strongly equivalent (with respect to Q) if a = a' 
or there is a path between them in Q* consisting solely of strong lines. Let 
£ = denote the set of strong equivalence classes in Q*, providing the 
decomposition V = [j(o-\a G £). If a - • - a' G £/*, then a — a' G VG7 G <5 

by the adicyclicity of G, so a - a' G £*. Therefore, = ({Q*)°) a = G a is 
a connected UG (possibly a singleton), each of whose lines is strong. For 
a G V, the unique strong equivalence class containing a is denoted by cr(a). 

Lemma 3.6. Suppose that a G a and 6 G /3 /or distinct a, (3 G £ = £(£/)■ 

(a) If b ( resp. , a — b&G) for some G G and a' • • • 6' G G /or a 
pair a' G a, 6' G /?, i/ien a' — > 6' G G7 (resp., a' — b' GGJ. 

(b) If a^be Q* (resp., a A 6 g and a' ■■■b' EQ* for a pair a' G a, 
6' G /?, toen a' A 6' G 6?* (resp., a'Aft'e 0*;. 

(c) 7/a A 6 G £/ien a —>b' £ Q* for every b' G /?. Furthermore, G^ nwpgt 
is complete. 
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(d) If a - b G Q* , then a' - b' G Q* for every pair a' € a, b' G (3. Further- 
more, Qa and Q% are complete. 

Proof, (a) is immediate by the adicyclicity of G and the connectedness 
of the subgraphs G a and Gp. 

(b) If a — > b G G, then a — > 6 G Gi and a — b £ G2 for some Gi, G 2 G 
£/, while a 6 G G3 for all other G3 G Q. Therefore, by (a), a' — > b' G Gi, 
a' -b'e G 2 , and a' 6' G G 3 , hence a'™ 6'e 0*. Similarly, if a A 6 g 0*, 
then a' A &' G (?* ■ 

(c) By Lemma 3.2(b), a A 6" g <5* for all strong neighbors 6" of 6 in £/*, 
so by the connectedness of Q%, a A b 1 G £/* for every 6' G /?. Next, suppose 
that a', a" G afl wpg, (/?) . It follows from the preceding that a' A b G £?* and 
a" A fe g g*. By (a), therefore, 3G 1 ,G 2 G Q such that a' -> b G G x and a" -> 
b G Gi, but a' - b G G 2 and a" - 6 G G 2 . Thus, a' ■■■a" G £*, for otherwise 
the triplex ({a', a"}, 6) would occur as the immorality a' — > 6 <— a" in Gi, 
but this triplex would not occur in G 2 . 

(d) By Lemma 3.2(b), a-b" G £/* for all strong neighbors b" of 6 in Q*, so 
by the connectedness of Gp, a-b G Q* for every 6 G f3. Similarly, a -b G Q 
for all a' G a. Next, for any a', a" G the preceding shows that a' - 6 G £/* 
and a" -beg*. By (a), 3 Gi, G 2 G Q such that a' -> 6 G Gi and a" -»■ 6 G Gi, 
but a' <— 6 G G 2 and a" <— 6 G G 2 . Thus, a' ■ ■ - a" G £7*, for otherwise the 
triplex ({a', a"}, 6) would occur as the immorality a' — > 6 <— a" in Gi, but 
this triplex would not occur in G 2 , hence £/* is complete. Similarly, Q% is 
complete. □ 

Definition 3.2. For each G = (V, E) G Q, define the reduced graph G = 
(S = X(G),E) as follows: a -► /3 G G (resp., a-/3GG) iff a^&jG (resp., 
a — 6 G G) for at least one pair a G a, 6 G f3. The reduced graph Q* = (E, E 1 *) 
is defined similarly. 

By Lemma 3.6(a), G is well defined. Since G and G are adicyclic, G° = 
G = (G)°. Clearly, Q* has the same skeleton as G for each G G £/, and 
a • • • /? G Q* iff a • • • b G £/* for some pair a G a, 6 G /?. The arrow a — > /3 G Q* 
is called wea& (resp., strong) if a A 6 G Q* (resp., a A b G <5*). All lines 
a — /? G <5* are called weak because each line a — beQ* (a G a, 6 G /3) must 
be weak. 

The following fact will be used repeatedly. Consider the following four 
statements: 

1. a^(3tW] 

2. a^>/?GG for all G G <7; 

3. «^/3gG for some G G £/; 
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4. a^PeQ*. 

Then 1 ^==> 2^3 ^==> 4. 

Lemma 3.7. (a) IfG&Q, then G has no chordless undirected cycles. 
(b) If a — > (3 <— 7 occurs as an immorality in G for some G £ Q, then 
the triplex ({0,7},/?) occurs in G' for every G' € Q. 

Proof, (a) If (ao,a±, . . . = o~q) comprises a chordless undirected Re- 
cycle in G, then, by the definition of G and the connectedness of each Q ai , 
there exist < j < ^i} C o-j, i = 1, . . . , k, such that (sn, . . . , si m , . . . , s^i, 

. . . , Sfc nfe = sn) is an undirected /-cycle in 67 (/>&;). If we choose the /-cycle 
of this form that minimizes /, this cycle must be chordless. By Lemma 3.3, 
each line Si ni — su+-\\\ must be strong in Q*, but also must be weak in Q* 
since Si ni G Uj and S(j+i)i € Ci+i, a contradiction. 

(b) Because a — > (3 <— 7 occurs as an immorality in G, a =4> <= 7 occurs 
in £/* with q-/- 7. If a ^> (3, a — (3, (3 7, or /3 — 7 occurs in then, by 
Lemma 3.6(a), (b), (c), (d), 3a £ a, b € (3, and c € 7 such that a — > 6 <— c 
occurs as an immorality in 67. In this case ({a, c}, b) must occur as a triplex in 
each G' 6 £/, hence ({0,7},/?) must occur as a triplex in 67' for each 67' G £/. 

In the remaining case, a — > /? <— 7 occurs in Q*. By the connectedness of 
Q%, 3 a S a, bo, . . . ,b n £ (3 (n > 0), and c € 7 such that a A 6 - • • • — b n ^" c 
occurs as a subgraph of Q* and thus as a subgraph of each G' € Q. Therefore, 
a — > /? <— 7 occurs as an immorality (a triplex) in 6' for each G' €Q. □ 

Lemma 3.8. ( a) Let ct,/3 6S = fre distinct strong equivalence classes. 
An arrow (3 £Q* is contained in some semi-directed cycle in Q* if and 
only if there exist a £ a and b € f3 such that a — > 6 £Q* is contained in some 
semi-directed cycle in Q* . In this case, every arrow a' — > b' € Q* between a 
and (3 is contained in some semi-directed cycle in Q* . 

(b) Q* is adicyclic iff Q* is adicyclic. In general, [Q*)° = {Q*)° . 

Proof, (a) "Only if": This follows immediately from the fact that any 
two vertices in a strong equivalence class are connected in Q* via a path 
consisting of strong lines. 

"If" : Let a — ► b =>• d\ ^ ■ ■ ■ =>■ (di = a) be a semi-directed /-cycle in Q* 
(I > 3). Consider the largest i = 1, ...,/ — 1 such that di E (3. Since di => 
rfj+i £ Lemma 3.6(b) implies that er(cZj + i) 7^ a, hence i <l — 2, 7 := 
cr((ij+i) 7^ a,/3, and a — > /? =>■ 7 occurs as a subgraph in £/*. Next, consider 
the largest j = i + 1, ...,/ — 1 such that dj G 7. Then 5 := <r(dj + i) 7^ /3, 7 and, 
since =>■ dj+i G£?*,a— >/3=^7=^<5 occurs in Q* . Either 5 = a, producing a 
semi-directed 3-cycle of the desired form, or this process may be continued 
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until a semi-directed A;-cycle a — > (3 => 7 5 =4> • • • =^ a (k > 4) in £/* is 
obtained. The final statement is immediate. 

(b) The first part follows from the first statement in (a). By Lemma 3.5, 
(G*)° G Q, so {Q*)° is well defined; clearly, it has the same skeleton as Q* 
and {G*)° ■ Suppose first that a — > [3 G Then a — > /3 G £/* and a — > /3 

cannot occur in a semi-directed cycle in Q* . Select a G a and 6 £ (3 such that 
a — > 6 € £/* . By (a) ( "if" ) , a — > b cannot occur in a semi-directed cycle in Q* , 
hence a -> 6 G (£*)°, so a -> /3 G_(£*)°. 

Suppose next that a — (3 G so either (i) a — (3 EG*, (i i) a — > /3 G 

or (iii) a <— /? G £/*. In case (i), it follows directly that a — (3 E (G*)°- In case 
(ii), a — > j3 must occur in some semi-directed cycle in £/*, hence by (a) ("only 
if") again a- [3 E (G*)°; case (iii) is similar to (ii). Thus, (G*)° = {Q*)° ■ □ 

Lemma 3.9. (a) Q* has no flags or chordless undirected cycles. 

(b) // a — > (3 — 7 occurs as a subgraph in Q* , then a 7 G £?* . 

(c) ^4ny triplex (necessarily an immorality) in Q* is a triplex in G for 
each G G G ■ 

Proof, (a) If a — > (3 — 7 is a flag in G*, then /3 — 7 is a weak line and, 
by Lemma 3.6(d) and the definition of G*, there exist a E a, b G [3, c G 7 
such that a — > b — c is a flag in Q* . Therefore, b — c must be a strong line in 
Q* by Lemma 3.2(a), but b — c is a weak line, thus, a contradiction. 

Next, if (ctq, (Ti, . . . , <7fc = 70) is a chordless undirected fc-cycle in £?*, then 
by Lemma 3.6(d) and the definition of Q*, there exist s» G 0j, £ = 1, . . . , fc, 
such that (so, si, . . . , s& = so) is a chordless undirected fc-cycle in Q* . Each 
line Sj_i — si G £?* is weak, but, by Lemma 3.3, each line Sj_i — s» G {7* must 
be strong, a contradiction. 

(b) By (a) , a ■ ■ ■ 7 G 0* . Because /? — 7 must be weak, we can choose G EG 
such that /3 — ► 7 G G, hence, the triangle a =>■ /3 — > 7 • • • a occurs in G. Since 
G is adicyclic, a — > 7 G G, hence a => 7 G £/*. 

(c) By (a), any triplex in £/* is an immorality, say a — > /3 <— 7. If either 
arrow is weak, then by Lemma 3.6(c) there exist a € a, b E 13, CG7 such 
that a — > 6 <— c is an immorality in <5*. Thus, by Lemma 3.1, ({a, c}, 6) is a 
triplex in G, so by the definition of G, ({0,7},/?) is a triplex in G. If both 
arrows in a — > [3 <— 7 are strong, then there exist a E a, b,b' E [3, c G 7 such 
that a->6sG and b' <— cEG, hence a — > /? <— 7 is an immorality in G. □ 

Lemma 3.10. faj Any semi-directed cycle in Q* has at least one (weak) 
line. 

(b) //a— >/3=>5=>aisa semi-directed 3-cycle in Q* , then there exist 
G,G' EG such that a (3 <— 5 — > a occurs in G and a =4> (3 — > <5 <— a occurs 
in G' . Therefore, the semi-directed 3-cycle in Q* must have the form a — ► 
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(c) In this case, a — > (3 cannot occur in Q* in a triplex (necessarily an 
immorality a — > (3 <— 7J or in an induced subgraph of the form 7 — > a — > /3. 

(d) Tjf (To — > <Ti • • • =>■ (cjfc = (To) is a semi-directed k-cycle in Q* (k>3), 
then each o~{ has at least one weak neighbor in Q* . Thus, by Lemma 3.6(d), 
the induced subgraphs Q* 1 , . . . , G* k are complete. 

Proof, (a) This follows directly from Lemma 3.4(a), using the fact that 
each Q*, a € £, is connected. 

(b) The proof is the same as that of Lemma 3.4(b). 

(c) Assume that the immorality a — > (3 <— 7 occurs in Q*. Let G, G' be as 
specified in (b); since a-/- 7, necessarily 7 7^ 6. Because (3 ^ j £ G* , neces- 
sarily (3 <= 7 S G, G' . Since S — (3 <— 7 occurs as a subgraph of Q*, necessarily 

5 <= 7 € £7* [Lemma 3.9(b)], hence also <5---7 £G,G'. Thus, the triangle 

6 7 • • • 6 occurs in G', hence 5 <— 7 € G by the adicyclicity of G. 
Therefore, a — ► (5 <— 7 occurs as an immorality in G', so by Lemma 3.7(b), 
({a, 7}, 5) must occur as a triplex in G. But this is impossible because 
a <— 5 6 G. The impossibility of the occurrence of 7 — > a — > /? as an induced 
subgraph of ^* is proved by a similar argument. 

(d) Use induction on k. By (b), the result is true when k = 3. Suppose 
it is true for all k' < k. By (a), at least one edge in the /c-cycle is a weak 
line. Let aj - o~j + i be the first such edge (1 < j < k — 1), so (Tj_i — > crj - <Tj + i 
occurs in Thus, (Tj_i Cj+i € ^* by Lemma 3.9(b). If j > 2, then <ro — > 
o"i => • • • =>■ Uj-i =>•■■• (<Tfc = (To) is a semi-directed {k — l)-cycle 
in Q*, so by the induction hypothesis, each of its vertices has at least one 
weak neighbor in Q* . Because the vertex aj also has a weak neighbor (<jj+i), 
the asserted result holds. If j = 1, then the cycle uq =^ 02 => ■ • • =>- (cfc = (To) 
occurs in If o"o — ► o"2 G then this cycle is semi-direct and the induction 
hypothesis again yields the asserted result. If <to -02 € then either the 
cycle is completely undirected, in which case the asserted result obviously 
holds, or else it has at least one arrow, in which case the cycle is semi-directed 
and the induction hypothesis again applies. □ 

Lemma 3.11. (a) An immorality a —>/?<— 7 occurs in Q* iff it occurs 

in 

(b) Neither Q* nor (G*)° has any flags. 

(c) {Q*)° has no chordless undirected cycles. 

Proof, (a) Note that Q* C (Q*)° and they have the same skeletons. 
Thus, if the immorality a —>/?<— 7 occurs in (Q*)° , it must occur in Q* . 
Conversely, suppose that a — > (3 <— 7 occurs in Q* but not in {Q*)° . Then 
at least one of these two arrows must occur in a semi-directed cycle in Q* 
and so is converted to a line in (Q*)°) also a-/- 7 in both graphs. Choose the 
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immorality a — > (3 <— 7 associated with a semi-directed cycle of minimum 
length k [minimum with respect to all immoralities a' — > (3' <— 7' in Q* that 
do not occur in and assume without loss of generality that this cycle 

contains a — ► /3. This cycle thus has the form a — > ((3 = 8\) 82 => • • • => 
ee q) in P*. By Lemma 3.10(c), fc > 4. 

It may be that <5j = 7 for some (at most one) i = 3, . . . , k — 2. In that 
case, however, f3 <— (7 = Si) occurs in a shorter semi-directed cycle 7 — > ((3 = 
Si) ■ • ■ (Si = 7) in contradicting the minimality of fc; hence, 5j 7^ 7 
for each i. By Lemma 3.10(a), the minimal-length semi-directed cycle has 
at least one line Sj - <5j+i € £?* (1 < j < fe — 1); consider the minimal such j. 

Suppose first that j > 2, so 8j~\ — > 5j — 5j + \ occurs as a subgraph of Q* . 
By Lemma 3.9(b), Sj-i =^ 8j + \ G Q*, hence a — > (/3 = £1) =^ • • • =>- <5j_i =4> 
• • • (<5fc = a) is a shorter semi-directed cycle in Q* containing a — > 
(3, contradicting the minimality of k. 

Suppose next that j = 1, so {(3 = 8±) — 82 € Q* ■ By Lemma 3.9(b), a =^ 
82 <= 7 occurs as an induced subgraph in By Lemma 3.10(c), neither 
edge can be a line, hence a — > 82 <— 7 occurs as an immorality in Q*. But 
now a —s- 82 occurs in a shorter semi-directed cycle a — > 82 => • ■ ■ => (5fc = a) , 
contradicting the minimality of /c. 

(b) By Lemma 3.9(a), Q* has no flags. Assume that a — > /3 — 7 occurs as a 
flag in (Q*)° . Then necessarily a — > /3 G C?*, so by (a), a — > /3 — > 7 occurs as a 
chordless 2-dipath in Q* , and /? — > 7 occurs in some semi-directed cycle in £/* : 
/? — > (7 = 5i) 5 2 • • • =4> (8k = (3), with k > 4 by Lemma 3.10(c). Choose 
the flag a — > (3 — 7 in (Q*)° such that the associated semi-directed cycle has 
minimal length k. [Note that 8i 7^ a for each i; otherwise a — > /3 would be 
included in a semi-directed cycle in Q* and would thus be converted to a — [3 
in (G*)°, a contradiction to the original assumption.] 

By Lemma 3.10(a), the semi-directed cycle must have at least one line 
Sj — <5j+i € Q* (1 < j <k — 1); consider the minimal such j. If j > 2, then the 
minimality of k is contradicted exactly as in (a), hence j = 1 and (Ji — <^2 € . 
By Lemma 3.9(b), [3 ^ 8 2 £~G* ■ If /3 — <5 2l _then /3 -»• (7 = £1) - 8 2 - is a 
semi-directed 3-cycle containing (3 — > 7 in contradicting Lemma 3.10(c); 
hence /3 — » € • 

If «■/• 82 in £/*, then a — > f3 — > 82 occurs as a chordless 2-dipath in Q* and 
(3 — > 82 occurs in the semi-directed cycle (3 — > 82 =^ • • • =>• (8k = /?), contra- 
dicting the minimality of k. If a- - -82 in Q* , then a — > 82, since otherwise 
a — > /? would occur in the semi-directed cycle a — > (3 — > 7 — 52 => a in ^* , 
hence would be converted into a — (3 in (^*)°. But now a — > ^2 — 7 is a flag 
in Q* , contradicting Lemma 3.9(a). 

(c) Suppose that (Q*)° has a chordless undirected cycle which has no 
triplexes. By Lemma 3.9(a), Q* has no such cycles, so has at least one arrow 
in this cycle. If Q* has at least one opposing arrow in this cycle, it must have 
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at least one triplex therein. If it has no opposing arrow, then it has at least 
one line [Lemma 3.10(a)], so again at least one triplex therein. But by (a) 
and (b), Q* and (Q*)° have the same triplexes, hence a contradiction. □ 

Theorem 3.2. Q* is adicyclic (i.e., is a chain graph) and Q* EQ. 

Proof. By Lemma 3.8(b), to show that Q* is adicyclic, it suffices to 
show that Q* is adicyclic, that is, Q* = (G*)° . To simplify notation, set 
K := Q*. By Lemma 3.11, K and K° have the same immoralities, have 
no flags and K° is a chain graph each of whose chain components (K )^, 
n G E(K°), is chordal. [Note that ijCSe £(<?)•] 

Because K C K°, it suffices to show that if a — (3 G K°, then a — /3 G K. Let 
r\ G S(K°) be the unique chain component of K° such that a — (3 G (K )^. 
Since it is chordal, {K°) rj admits two perfect directed versions, say, D v and 
D' , such that a—> [3 G D v and a <— (3 G D' . (Apply Maximum Cardinality 
Search starting first at a and next at (3.) Extend D v and D'^ to directed 
graphs D and -D', each having the same vertex set £ and the same skeleton 
as K and if , by assigning perfect orientations (the same for D and D') to 
all other chain components (K°) x , x € S(K°), x ^ V- Thus, every arrow in 
K° also occurs in D and D', while a — > (3 € D and a<— (3 € D'. 

It is readily verified that D and D' are acyclic (since K° is adicyclic 
and perfect orientations of chordal graphs are acyclic) and have the same 
immoralities as K and K° (since K° has no flags, perfect orientations of 
chordal graphs are moral, and every arrow in K° also occurs in D and D'). 

Now consider the "un-reduced" versions H of D and H' of D'. That is, 
H and H' have the same skeleton as Q* , while if c- • -d 6 Q*, then: 

A: c-d£H,H> i&c-deg*, that is, H CT = H' a = G* VcreS; 
B: c^deH (reap., iff er(c) -> a(d) e I? (reap., £>')■ 

In case B, either 

Bl: cr(c) — > cr(d) € in which case a(c) — > cr(d) £ .fT, or 
B2a: cr(c) - cr(d) G iT° and cr(c) - cr(d) G or 

B2b: a(c) — cr(d) G K° and <r(c) <-> &(d) G if but the arrow <-> is contained 
in a semi-directed cycle in if. 

Note that if a G a and 6 G /3 are chosen such that a - ■ - b G Q* , then a — > 
6 G i? and a <— 6 G il'. If we can show that ff, G ^, then a — 6 G £7* , so 
a — /? G ^* = if, which would complete the proof of the adicyclicity of Q* . 
Since D and D' are acyclic, H and H' are adicyclic by their construction. 
Therefore, it suffices to show that H and H' have the same immoralities and 
the same flags as Q* , hence, the same triplexes. 
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(i) Suppose that c — > d<— e occurs as an immorality in Q* . By Lemma 3.5(a), 
this immorality also occurs in (Q*)°, so the arrow(s) a(c) — > <r{d) and cr(d) <— 
a(e) occur in (Q*)° = (G*)° = K° [Lemma 3.8(b)] and therefore occur in 

D and D' . [Note that it is possible that <r(c) = cr(e).] Thus, c—>d and d <— e 
both occur in H and H 1 so, since c-/ e in H and ii 7 , c — > d <— e occurs as an 
immorality in ii and H' . 

(ii) Suppose that c A <i- e occurs as a flag in By Lemma 3.5(b), this 
flag also occurs in {Q*)° , so the arrow a{c) — > cr(<i) occurs in (Q*)° = (Q*)° 

f\ and therefore in D and D' . Thus, d — e occurs as a flag in H and 
if'. 

(iii) Suppose that c — > d — e occurs as a flag in H (or if'). Then c- • -d—e 
occurs as an induced subgraph of Q* and a(c) — > <r(<i) € I? (or D'). Consider 
the three possibilities Bl, B2a, B2b for the edge a(c) ■ ■ -a(d): 

Bl: Here cr(c) — > <r(d) G if = (7*, so c— > d-e occurs as a flag in Q* . 

B2a: Here <r(c) - cr(<i) G if so c - d &G*, hence c-d-e&G*, hence c - 
e £Q* [Lemma 3.2(b)]. But c-/- e in a contradiction. 

B2b: Here a(c) <-> c((i) € if and the arrow occurs in a semi-directed cycle 
in ^ = 5*, so by Lemma 3.8(a), c «-> d must occur in a semi-directed cycle 
in Thus, either c^d-e occurs as a flag in (/* but not in (Q*)°, con- 
tradicting Lemma 3.5(b), or c <— d— e occurs as an antiflag in but not in 
(5*)°, contradicting Lemma 3.5(c). 

(iv) Suppose that c — > d <— e occurs as an immorality in if (or ii'). Then 
c- • -d - ■ -e occurs as an induced subgraph of Q* , and <r(c) — > a(d) £ D (or 
D'), (7(c) -> <r(d) G i) (or £>')■ 

First, assume that <t(c) =a(e). Again consider the three possibilities Bl, 
B2a, B2b for the edge a(c) ■ ■ ■ a{d): 

Bl: Here a(c) — >• cr(d) £ K = Q*, so c — > d <— e occurs as an immorality 
in G*. 

B2a: Here <r(c) - a(d) G K, so c— d £ Q* , e - d £ Q* , and C7*,x = 0*r e \ is 
complete [Lemma 3.6(d)], but c-/-e in C/*, a contradiction. 

B2b: Here a(c) <-* cr(d) G K and the arrow occurs in a semi-directed cycle 
in K = Q* , so G^fA = ^a(e) * s com pl e te [Lemma 3.10(d)]. But c-/- e in £/*, 
a contradiction. 

Second, assume that <r(c) ^cr(e). As above, three possibilities (Bl, B2a, 
B2b) exist for the edge a(c) ■ ■ ■ <r{d) in K° . Similarly, three possibilities (Bl', 
B2a', B2b') exist for the edge a(e) ■ • -cr(cZ) in K°: 

Bl': cr(e) — > a(d) G K°, in which case a(e) — > a(d) G K, or 
B2a': a(e) - a(d) G if ° and <r(e) - <r(d) € if, or 

B2b': <r(e) — a(d) G if° and <r(e) «-> cr(d) G if, but the arrow «-> is con- 
tained in a semi-directed cycle in if. 
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Thus, we must consider the nine cases (Bl, Bl'), (B2a, Bl'), (B2b, 
B2b'). 

(Bl, Bl'): Here a(c) -» a{d) G K and a(e) -» a(d) G if = Q*, so c-> 
d <— e occurs as an immorality in Q* . 

(Bl, B2a'): Here a(c) — » cr(d) G if and <r(e) - er(d) G If, so c — ► d - e oc- 
curs as a flag in £/*, contradicting Lemma 3.2(a). Similarly, the case (B2a, 
Bl') is also impossible. 

(Bl, B2b'): Here a{c) — > cr(d) G If and cr(e) <-> <r(d) G if with the arrow 
<-> contained in a semi-directed cycle in if = Q*. By Lemma 3.8(a), e «-> d 
must occur in a semi-directed cycle in Q* , so either c — > d <— e occurs as an 
immorality in (/* but not in (G*)°, contradicting Lemma 3.5(a), or c — > d — > e 
occurs as a chordless 2-dipath in Q* but c—>d — e occurs as a flag in (5*)°, 
contradicting Lemma 3.5(b). Similarly, (B2b, Bl') is impossible. 

In the remaining four cases (B2a, B2a'), (B2a, B2b'), (B2b, B2a') and 
(B2b, B2b'), a(c) — a(d) — a(e) occurs as a subgraph in if . Because a(c) — > 
<r(d) <— a(e) occurs as a subgraph in D (or D') and isT° has the same im- 
moralities as D, D' , necessarily <r(c) • • • cr(e) G if = Q* in these four cases. It 
cannot occur that <r(c) - <r(e) G if [otherwise c • • • e G <?* by Lemma 3.6(d)], 
so <r(c) <-> cr(e) G if. Therefore, 3c' G <r(c), e' G <r(e) such that d <-> e' G 
Since c-/- e in Q*, either c / c' or e / e' (or both). 

(B2a, B2a'): Here <r(c) - <r(d) G if and <r(e) - <r(d) G if = 0*, so c - d G 
(/*, e — d G £/* , and both £7*/ c ) and (?^( e ) are complete [Lemma 3.6(d)]. Thus, 
c' <-> e' occurs in a semi-directed cycle in Q* . 

(•) If we assume that c 7^ c', then c — d<r+e' occurs as a subgraph of 
£/*. In this case c «-> e' G (?*, for otherwise the subgraph would occur as 
an antiflag or flag in Q* but not in (G*)°, contradicting Lemma 3. 5(c), (b). 
Therefore, e' ^ e (since c-/- e in Q*), so c <-> e' - e occurs as a subgraph of 
(?* . By the same reasoning, c <-> e G Q* , thereby contradicting the fact that 
0/ e G £/*. The same contradiction is obtained if we assume first that e/e'. 

(B2a, B2b'): Here cr(c) - <r(d) G if and a(e) <-> a{d) G if with the arrow 
<-> contained in some semi-directed cycle in if. Thus, G*^ is complete by 

Lemma 3.6(d) and Q^i e \ is complete by Lemma 3.10(d), so c— c' G Q* if c 7^ c' 

and e - e' G £/* if e / e'. Because the triangle <r(c) - a(d) <-> <r(e) <-> a(c) 
occurs in if = Q* and has exactly one line, by Lemma 3.10(b), it cannot 
occur as a semi-directed 3-cycle. This leaves two possible configurations for 
the triangle in Q*\ a(c) - a(d) <— a{e) — > a(c) and a(c) - a(d) — » cr(e) <— c(c), 
and in both cases the arrow between cr(d) and a{e) is contained in some 
semi-directed cycle in Q* . 

If the first configuration obtains, therefore, there exists a path <r(d) => 
<5i =>■ • ■ • => (5fc = c(e)) in £?* (fc > 2). If each <5j 7^ c(c), then cr(e) — ► <r(c) is 
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contained in the semi-directed cycle a(d) — ► a(c) - a(d) =>• Si =>• • • • (Sf. = 
cr(e)) in Q*, while if <5j = cr(c) for some (at most one) i = 2, . . . , k — 1 (so 
k > 3), then a(d) — > <r(c) is contained in the semi-directed cycle a(e) — > 
(cj(c) = 6i) =>•••=$■ (6],. = cr(e)) in £/*. In both cases, therefore, d — > d is 
contained in a semi-directed cycle in Q* by Lemma 3.8(a). If the second 
configuration obtains, a similar argument shows that d — > d is contained in 
a semi-directed cycle in Q*. Now a contradiction is reached exactly as in (•). 
Similarly, (B2b, B2a') is also impossible. 

(B2b, B2b'): Here a(c) <-> a(d) G K and cr(e) <-> cr(d) G X, with the ar- 
rows <-> both contained in semi-directed cycles in K. Since also o~(c) <-> 
cr(e) G if, cr(c) <-> a(d) <-» cr(e) <-» cr(c) occurs as a triangle in if = £/*. Of 
the eight possible orientations, two are cyclic but have no lines, hence are 
impossible by Lemma 3.4(b), leaving six acyclic possibilities: a(c) —> o~(d) <— 
a(e) — > cr(c), a(c) <— a(d) <— a(e) — > cr(c), and so on. The argument in the 
preceding paragraph can be extended to show again that d «-» d occurs in a 
semi-directed cycle in Q* , and again a contradiction is reached exactly as in 
(•)• 

Thus, we have established that H and H' have the same triplexes as Q* , 
so the proof of the adicyclicity of Q* is complete. Last, it follows now from 
Lemma 3.1 that Q* G Q. □ 

Remark 3.1. For subsequent use, we summarize the properties of the 
graphs H and H' constructed in the preceding proof: H and H 1 are adicyclic 
and have the same skeleton, immoralities and flags as Q*, so H, H' G Q. Each 
strong line in Q* occurs as a line in H and H', each arrow in Q* occurs as 
an arrow with the same orientation in H and H' , and each weak line in Q* 
is converted to an arrow in H and H'. Further, if a weak line a — b G Q* is 
specified, H and H' can be chosen such that a — > b G H and a <— b G H' . 

4. Local properties of AMP essential graphs. Having established that 
Q* and Q* are adicyclic, some of the results in Lemmas 3.2 and 3.9 can be 
sharpened and extended. These then yield information about the possible 
local configurations of strong/weak arrows/lines in Q* = (V,E*). 

A chain component £ G S(Q*) is nontrivial if |£| > 2, so that £/| contains at 
least one line. A nontrivial chain component £ is called strong (weak) if each 
line in C?| is strong (weak). For v G V, denote the unique chain component 
of Q* that contains v by £(v) =£g*(v). 

Lemma 4.1. (&)Ifa^b-c occurs as a subgraph in Q* , then a^c£ 
Q* . Thus, if £(b) is weak, then a — > V \f V G £(6) . 

(b) If a — > (3 — 7 occurs as a subgraph in Q* , then a — > 7 G ^* . 



MARKOV EQUIVALENCE FOR AMP CHAIN GRAPHS 



21 



(c) If a — > 6 - c occurs as a subgraph in Q* , then a — > 6' -d and a — > d 
occur as subgraphs of Q* for all b' G a(b) and d G o"(c). 

(d) T/ie configuration a - 6 - c cannot occur as an induced or noninduced 
subgraph in Q* . 

Proof, (a) and (b) By the adicyclicity of Q* and Q*, these results follow 
immediately from Lemmas 3.2(b) and 3.9(b) and the connectivity of £(&). 

(c) By Lemma 3.6(d), a — > b — d — b' occurs as a subgraph in Q* . Therefore, 
a — > c' — 6' occurs in (?* by (a), whence a — > 6' G Q* also by (a). [Note that 
if the arrow a — > 6 is weak, the result concerning a — > 6' — c' follows from 
Lemma 3.6(c), (d), and in turn implies that a — ► d G Q* by (a).] 

(d) Assume that a — b- c occurs as a subgraph in Q* and let £ = £ (a) = 
£(6) = £(c). By Lemma 3.6(d), a'-deQ* Va'eo-(a), c'gct(c), and <r(o) = 
<7 (6) and a(c) are complete subsets of £. Since every a G £((7) such that 
cr C £ must be connected to a (a) by a path of weak and strong lines, it 
follows that every such a is complete. This implies that any chordless cycle 
C in t/| must contain at least one weak line d — e, hence 3G G Q such that 
either d->e6Gord^eGG. But this and the adicyclicity of G imply the 
existence of a triplex in Gc, while Qq, being undirected, has no triplexes, a 
contradiction since G and Q* have the same triplexes. Thus, can have no 
chordless cycles, hence is chordal. 

Thus, C/| admits a perfect directed version F% (apply MCS), so the edge 
a---b occurs as an arrow in F^. Let F be the graph obtained from Q* if 
we replace <7| by F%, so F C Q* . Clearly, F has the same skeleton as Q* 
and is adicyclic: any semi-directed cycle in F cannot be wholly contained 
in £ since F^ is acyclic, hence such a cycle must contain at least one arrow 
from Q* , so would correspond to a semi-directed cycle in Q* which, however, 
is adicyclic. Because F differs from Q* only in that all lines in C?| become 
arrows in F, because no triplexes occur within F^ or (the orientation 
in F^ is perfect, while C?| is undirected), and because neither F nor Q* has 
a line d — e with e G £ and / G V \ £ [since £ G E(C/)], the triplexes of F 
and £/* can differ only if, for some e, / G £, d — > e — / occurs as a flag in 
£/* but d — ► e — > / G -F. The former is impossible if e — / is weak in (/* 
[Lemma 3.2(a)], so assume e - / G Q*. Since a(e) C £, 3 (7 G (£ \ cr(e)) such 
that e-g^G* [Lemma 3.6(d)], so, since / G <r(e), d — > / G ^* [set a = d, 
b = e, c = 5 and 6' = / in part (c)]. Thus, d — > e — / cannot occur as a flag 
in £/*, so -F and Q* have the same triplexes, hence F €Q. Since a - ■ - b occurs 
as an arrow in F, a — b cannot be a strong line in Q* , contrary to assumption. 
□ 

Proposition 4.1. ( a) Every nontrivial chain component of Q* is either 
strong or weak. 
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(b) A nontrivial chain component £ G is strong iff contains 

either a chordless undirected cycle or a flag, where £ = clg*(£) = £Upag*(£). 
In fact, <7| must contain either a chordless undirected cycle or a biflag. 

PROOF. Lemma 4.1(d) yields (a); Lemmas 3.2(a) and 3.3 yield "if" in 
(b). 

(b) "only if" : Assume that £ is strong but <5| contains no chordless undi- 
rected cycles or biflags. Suppose first that <7| has no flags. Because C?| is 
chordal, we can define F% and F as in the proof of Lemma 4.1(d). Then as 
above, F is adicyclic and has the same skeleton and triplexes as Q*, hence 
F G Q. Because all edges in Fg are arrows, however, the corresponding edges 
in C/| cannot be strong lines, a contradiction. 

Suppose next that C?| has at least one flag, say, a* — > b* — c* with 6*, c* G £. 
Let F be the graph constructed from Q* by converting each such flag into an 
immorality a* — > b* <— c* . This process is unambiguous since b* — c* cannot 
occur in a 2-biflag in Q* . Since F C Q* and they have the same skeleton, 
each chain component p of F satisfies either pC^ or p n £ = 0. Define 

Zt(F):={peZ(F)\pC!i}, 

so £ = U {pIp ^ ^C^ 1 )}- We shall establish four properties of F: 

(1) -F is adicyclic. If F were not adicyclic, it would contain a semi- 
directed cycle Co — ► c\ =>■ • • • c& = Co (A; > 3). Because F C Q* and £?* 
is adicyclic, this cycle must be completely undirected in Q* , in particu- 
lar, Co — ci G Q* , so there must exist a vertex a 7^ Co, c\, C2, C£_i such that 
Co — ci <— a occurs as a flag in Q* . (If fe > 5, then also a 7^ q for i = 3, . . . , k— 2, 
for otherwise ci =>■ C2 • • • => q — > ci would be a semi-directed cycle in £?*.) 
Further, a — > ci — C2 cannot occur as a flag in £/* (otherwise c\ <— C2 G -F), 
so a — ► C2 G £7*. Similarly, a — > a G (?* for i = 3, . . . , k, which contradicts the 
nonadjacency of a and c^ = Co in the flag Co — c\ <— a. 

(2) Each triplex in Q* corresponds to a triplex in F. This is immediate 
by the construction of F from Q* . 

(3) Each immorality in F corresponds to a triplex in Q* (but not every 
flag in F need correspond to a triplex in Q*). This holds since (?| contains 
no 3-biflag chains. 

(4) The moralized graph (cf. [4], page 40) L = L(p) := (F clF ( p )) m is chordal 
for each p G 'E^(F). If not, then L would contain a chordless /c-cycle Co — 
ci — C2 — ■ • ■ — Cfc = Co (k > 4), where each Cj G clp(p) = pUpa^(p). Since 
L p = F p = Q* and £/| is chordal, this cycle cannot lie entirely within p, so 
must intersect pa F (p). Since pa^(p) is complete in L, either (a) exactly one 
vertex of the cycle lies in pa F (p), say, c±, or (b) exactly two vertices of the 
cycle, necessarily consecutive, lie in pa F (p), say, cq = c^ and c±. 
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In case (a), C2, Ck G p, while c\ G pa^(p), so c\ — > C2 G i 7 and ci — > c& € F 
by (1) and the connectedness of F p , hence C\ =>■ C2 G <5* and c± ^ Ck € Q* ■ 
Because C2 — C3 G F p = Q* and Cfc_i — G F p = Q* , ci — C2 € £/* and ci — c& G 
(/* by the definition of F, so the cycle lies in <7| and is chordless, contradicting 
the chordality of Q^. 

In case (b), a similar argument shows that c\ — ► C2 G F and — ► Ck-i G i 7 , 
while ci — C2 G Q* and cj; — Cfc_i G Q* . Therefore, all vertices c±, . . . ,Ck lie in 
£, so ci and cannot be adjacent in Q* since £| is assumed to be chordal. 
(Instead, the line c\ — = Co in L must have been added by moralization.) 
Furthermore, by the definition of i 7 , there must exist vertices a, b (possibly 
a = b) such that c\ — C2 <— a and b — > c^-i — c& occur as flags in £7*. Thus, 
a 7^ ci, C2, C3 and, since the cycle is chordless in L, a 7^ C4, . . . , c^. Similarly, 
6 7^ ci, . . . , Cfe. Because q — Cj+i sFCg* for i = 2,...,k — 2 and C7| contains 
no biflag chains, necessarily a — ► Cj G £7* for i = 3, . . . , fc — 1 and b — ► q G 
C7* for i = fc — 2, . . . , 2. Thus, at least one of [a; ci, . . . , <%] , [6; ci, . . . , c&] or 
[a, b; c± , . . . , Ck] must occur as a fc-biflag in Q* , contradicting the assumption 
that C/| does not contain a biflag. Thus, (4) holds. 

Now construct a graph F' C i 7 with the same skeleton as i 7 , as follows. 
For each p G H^(F), assign a perfect orientation to the edges of the chordal 
undirected graph L(p) = (F clj? ( p )) m according to MCS starting at an arbi- 
trary vertex in pap(p) (if any), obtaining a perfect digraph D(p) with vertex 
set clp(p). Because pa^(p) is complete in L(p), MCS can be chosen to visit 
each vertex in p& F (p) before visiting any vertex in p itself. Thus, for any 
edge between a vertex in p& F (p) and a vertex in p, the orientations of this 
edge in D(p) and in F (and in F' defined below) are identical. 

Let F' C F be the graph obtained from F by orienting each undirected 
edge in F p (= Q*) according to its orientation in D(p), for each p G E^(F). 
Note that, for any pair d,eEV with either d g' £ or e ^ £ (or both), the edge 
d - ■ - e (if any) must be identical in £/*, i 7 and i 7 '. Also, every line in C/| is 
converted to an arrow in F' . We shall show that F' is adicyclic and has the 
same triplexes as £/*, hence F' EG- This contradicts the fact that every line 
in t/| (in particular, b* — c*) is strong, which will complete the proof. 

If F' were not adicyclic, it would have a semi-directed cycle which cannot 
lie entirely within any one p G 'Eg(F) since each D(p) is perfect. Nor can 
this cycle lie entirely outside £, since there F' coincides with F which is 
adicyclic. Thus, this cycle must contain two consecutive vertices c\ ■ ■ ■ Oi 
such that either c\ G p\ and C2 G pi for distinct p\ , p2 G (F) , or else c\ G £ 
and C2 ^ £. In either case the edge c\ ■ ■ -c-i must occur as an arrow in i 7 , 
so the cycle is also semi-directed in F (since F ~2 F'), contradicting the 
adicyclicity of F. 

Since Q* ~J F', each immorality in Q* remains an immorality in F' , while, 
by the construction of F and i 7 ', each flag d — > e — / in Q* either remains a 
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flag in F' (if e, / ^ £) or else is converted to an immorality in F' (if e, / G £). 
Also, by this construction, if — > e — / is a flag in i 7 ", then necessarily 
e, / ^ £, so this flag also occurs in £/*. 

Last, suppose that d — > e <— / is an immorality in i* 1 ' that does not occur as 
a triplex in Q* . Then d — e — f must occur as an induced subgraph in Qt, but 
d, e, / cannot all lie in the same p € r,^(F), since D(p) is perfect, hence has 
no immoralities. Without loss of generality, assume that d £ p\ and e G ^, 
where p\ ^ p2 ■ Thus, the edge d ■ ■ ■ e must be an arrow in F, hence d — ► e E F 
since F D F' , and e<^/eF for the same reason. If e <— f £ F, then d — > 
e <— f would occur as an immorality in F, hence by (3) would correspond 
to a triplex in Q* , contrary to assumption, so necessarily e — / € F and 
/ G p2- Thus, the edge d - ■ ■ f cannot be added in the moralization process for 
L(p2), hence cannot occur in D(p2), so d — > e <— / is an immorality in D(p2), 
contradicting its perfectness. Thus, F' and Q* have the same triplexes. □ 

We note that not every line in a strong chain component need be contained 
in a biflag or chordless cycle. Examples appear in [5, 6]. 

Let -Do = (V,Eq) be an ADG and let T> denote its ADG Markov equiva- 
lence class, the set of all ADGs D = (V,Ed) that are Markov equivalent to 
L>o- Andersson, Madigan and Permian [3] defined the ADG essential graph 

(4.1) £>* = U {D\D € V} :={V,\J(E D | D eV)) 

determined by T> and showed that it uniquely represents T>. For ADGs, in 
fact, the ADG and AMP definitions of essential graph are identical. 

Proposition 4.2. Q contains some ADG D iff G* has no biflags and 
all its chain components are chordal. In this case Q* = V* . 

Proof. Since Q* € G, the first statement follows from Proposition 3 of 
[4]. By Proposition 4.1(b), G* has no strong chain components, hence no 
strong lines. Clearly, each arrow in G* , strong or weak, must occur with the 
same orientation in every D € T>, so must occur in T>*. If a weak line a — b 
occurs in G* , then the graphs H, H' in Remark 3.1 are ADGs and belong to 
V, so the line a — b must occur in V* . Thus, G* = T>* . □ 

We now turn to a characterization of the arrows in G* ■ 

Definition 4.1. Let G = (V, E) be a chain graph. An arrow a^b £G 
is protected in G if it occurs in at least one of the seven configurations shown 
in Figure 5 as an induced subgraph of G. 

Definition 4.2. Let G = (V, E) be a chain graph. An arrow a^b£G 
is irreversible in G if replacing a — > b by a <— b creates or destroys a triplex 
or creates a semi-directed cycle. 
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Fig. 5. The seven protected configurations for an arrow a — > 6 € G . 



Determination of the irreversibility of an arrow in 67 apparently requires 
global knowledge of 67, since semi-directed cycles may be of arbitrary length. 
In fact, however, only local knowledge of G is required: 

Lemma 4.2. Let 67= (V, E) be a chain graph. An arrow is irreversible 
in G if and only if it is protected in G. 

Proof. Clearly, a protected arrow is irreversible. If a — > b is irreversible 
in G by virtue of a <— b creating (resp., destroying) a triplex, then a — > b 
must occur in configuration (i) or (vi') [resp., (ii) or (vii')] as an induced 
subgraph of G. If a — ► b is irreversible in G by virtue of a <— b creating a 
semi-directed cycle, then a — > (6 = d\) <t= d<i •<= • • • -4= (c4 = a) (k> 3) occurs 
as a subgraph in G. Since G7 is adicyclic, at least one -4= must be <— . 

Suppose first that b <— d<i € G. If a-/ cfo, then a — > b occurs in configuration 

(ii) with c = d2- If a - ■ -di in G, then either a ^ ^ 6 G, a — c?2 G 67 or 
a <— c?2 € G. In the first (resp., second) case a — > 6 occurs in configuration 

(iii) [resp., (v')] with c = c?2- The third case cannot occur, for otherwise k > 4 
and a <— cfo •£= • • • <= {dk = a) would be a semi-directed cycle in G. Suppose 
next that b — di G G. Then a similar argument shows that a — > b must occur 
in configuration (vii') or (viii') with c = d2- □ 

By the definition of Q* , each arrow a-+b €LQ* must be irreversible in Q* , 
hence, since Q* is a chain graph, protected in Q* . In fact, each arrow must 
be well protected in Q* . 

Definition 4.3. Let Q* = (V, E*) be an AMP essential graph. An arrow 
a — > b € Q* is well protected in Q* if it occurs in at least one of the eight 
configurations shown in Figure 6 as an induced subgraph of Q*. 
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Fig. 6. The eight well-protected configurations for an arrow a—>b£Q* 



Proposition 4.3. Each arrow in an AMP essential graph Q* is well 
protected in Q* . 

Proof. If £(a) is strong, hence, nontrivial, 3 c G £(a) such that c-a^ b 
is a subgraph of Q* . Here a — > b must occur in configuration (v) or (vi) in 

G* . If £(&) is strong, hence nontrivial, then 3 c G £(a) such that a — > 6 - c is a 
subgraph of Q* . Here a — > 6 must occur in configuration (vii) or (viii) in Q* . 

Last, assume that both £(a) and £(&) are weak (or trivial). In particular, 
a — ► b cannot occur in configuration (v), (vi), (vii) or (viii) in Q*. We shall 
assume also that it does not occur in configuration (i), (ii), (iii) or (iv) and 
obtain a contradiction. 

We begin by showing that Gq is complete, where 

(4.2) 8:={ce£(a)\c^beg*}. 

Note that a G 8. If c G 9\{a}, then c — ► 6 G £/*. Thus, c - ■ - a (necessarily 
c — a G £/*), for otherwise a — ► 6 <— c would occur as an immorality in Q* , 
contradicting the assumed nonoccurrence of a — > b in configuration (ii) in Q* . 
If c, c 7 G 9 \ {a} then c — > 6 G <5* and c' — >• 6 G <?* , while c - a G ^* and d — a G 
^* by the preceding argument, hence c — c' G <5* by the nonoccurrence of 
(iv) in Q* . Thus, 8 is complete. 

By Lemma 3.3, and G^r a \ are chordal UGs. Construct G from G* 

by assigning perfect orientations to the lines (if any) in these two UGs as 
follows. First, let q= \0\ > 1, let (ci, .. . ,c g _i) be an arbitrary numbering of 
#\{a} and let c q = a. Apply MCS to G^i a \ starting at c±. The completeness of 
Gq ensures that MCS can reproduce the initial sequence (c±, . . . , c q = a). The 
resulting perfect orientation in G of the lines of G^ a ^ satisfies the following 
two conditions: 
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(a) any line a — c G Q^ a ) with c G becomes a <— c in 67; 

(/?) any line a — d G {?|( a ) with (i € £(a)\# becomes a — > cf in G. Next, 
orient the lines in G^ b ^ according to MCS started at b; in particular, 
(7) any line b — c G £/|^ becomes b — > c in 67. 

Now construct G' from 6 by replacing a — > b by a <— 6, so £/*, 6 and 6' 
have the same skeleton. We shall show that G and 6' are adicyclic and have 
the same flags and immoralities as G* , hence 67, G' G Q. Thus, a — b G G* , 
the desired contradiction. 

Because G^ a ) and G^) are acyclic digraphs, any semi-directed cycle in G 
cannot be entirely contained in G^( a ) or in G^) , hence must include at least 
one arrow of G* . Since G C G* , this cycle must correspond to a semi-directed 
cycle in Q* , contradicting the adicyclicity of Q* . Thus, G is adicyclic. 

If d — > e <— / is an immorality in Q* , then it also occurs as an immorality 
in G, since both graphs have the same skeleton and G C £/* . If d — ► e — / is 
a flag in then cZ — > e G G and e - / G £7* [Lemma 3.2(a)] so e — / remains 
a line in G, hence tf — ► e — / is a flag in G. If d — ► e — / is a flag in G but 
not in £/* D G, then d — e — f occurs as an induced subgraph of G* and 
necessarily d-eG or ^|(6) > nence also e ~ / G £|( a ) or ^|(6) > so e " ' / 
must occur as an arrow in G, a contradiction. Finally, if (i — » e <— / is an 
immorality in G, but not in Q* , then at least one of these arrows, say, d — > e, 
occurs as a line d — e in G* , hence d-eG ^|(a) or ^l(fe)' so ^~ e e Since 
d - e <— / cannot occur as a flag in (7*, necessarily e — f EG*, so d — e — f 
occurs as an induced subgraph of G^r b \ or G^ b y But this subgraph cannot 
become an immorality d — > e <— / in G because the orientations of Gg(ft) and 
G^({,) are perfect, a contradiction. Thus, £?* and G have the same flags and 
immoralities. 

If G' were not adicyclic, then since G is adicyclic, G' must contain a semi- 
directed cycle with a^b, so this cycle must have the form a <— (6 = ci) -<= 
C2 • • • -4= (cfe = a) (A; > 3) in G'. Therefore, G must contain the subgraph 
a — > (6 = ci) -<= C2 -<= • • • <= (cfc = a) and, since G C Q* , a subgraph of this 
form also occurs in G* ■ Consider the edge b ■<= C2 in £/*. If 6 — C2 G then 
b — C2 G , hence 6 — > C2 G G by (7) , contradicting the occurrence of b <= C2 
in G. Next, if 6 <— C2 G 5*, then a ■<= C2 in C?* by the assumed nonoccurrence 
of (ii) and (iii) in G* ■ If this edge is a <— C2 in £*, then a <— C2 G G, so 
a <— C2 G G', which implies that A; > 4 and that a <— C2 ■<= • • • <= (ck = a) is a 
semi-directed cycle in G, a contradiction. If this edge is a — C2 in G* , then 
C2 G #\{a}, so a <— C2 G G by (a), leading to the same contradiction. Thus, 
G' is adicyclic. 

Suppose that an immorality d — > e <— / occurs in G but not in G' . Then 
one of these two arrows, say, d — ► e, must be a — ► 6, so a — > 6 <— / occurs as 
an immorality in G Q G* ■ Thus, either a^b^ f occurs as an immorality in 
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G* , contradicting the nonoccurrence of (ii), or a — > b — f occurs as a subgraph 
in Q* so b — > / G G by (7), a contradiction. If d — > e — / occurs as a flag in 
G but not in G', then the arrow d — > e must be the arrow o — > 6 in G, hence 
o — s- 6 — / occurs as a subgraph in G and therefore in £/*, so b — > / G G by 
(7), again a contradiction. If d — e <— f occurs as a flag in G 1 but not in 
G, then the arrow e<— f must be the arrow a <— b in G, so d — a — > 6 is a 
subgraph of G C 5*, hence d E But then the edge d - - -a must be an 
arrow in G, a contradiction. Finally, if d — ► e <— / occurs as an immorality 
in G' but not in G, then one arrow, say, e <— f, must be a <— b in G', so 
(i — > a — > 6 occurs as an induced subgraph inGCtJ*. Thus, either d — > a — > 6 
occurs as an induced subgraph in Q* , contradicting the nonoccurrence of 
(i), or d — a—> b occurs as an induced subgraph in Q* , so d G £(a)\9, hence 
d <— a £ G by a contradiction. Thus, G and G' have the same flags and 
immoralities. □ 

The examples in Figures 3 and 4 show that Proposition 4.3 is rendered 
invalid if any of the eight configurations (i), (ii), (hi), (iv), (v), (vi), (vii) 
or (viii) is excluded from the definition of well protection in Definition 4.3. 
However, weak arrows and strong arrows of Q* are well protected in more 
stringent fashions, namely, configurations (iv) and (vii) cannot occur for 
the well protection of weak arrows, while (vi) is not required for the well 
protection of strong arrows — see [5], Propositions 4.4 and 4.5. 

By Lemma 3.6(b), both arrows in configurations (v) and (viii) must be 
strong or both weak. The example in Figure 4(4) (resp., Figure 7) shows 
that if the strong line in (v) [resp., (viii)] is replaced by a weak line, then it 
can occur in Q* that one arrow is strong and the other weak. 

We conclude this section with an easy characterization of those directed 
graphs that can occur as AMP essential graphs. 

Theorem 4.1. A directed graph G is an AMP essential graph iff it 
is acyclic and each arrow is protected in G, that is, occurs in one of the 
configurations (i), (ii), or (hi) as an induced subgraph of G. Thus, the class 




Fig. 7. An AMP essential graph Q* . 
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of directed AMP essential graphs coincides with the class of directed ADG 
essential graphs. 

Proof. "Only if" follows immediately from Theorem 3.2 and Proposi- 
tion 4.3. "If" and the final statement follow from Corollary 4.2 of [3] and 
Proposition 4.2. □ 

5. Characterization of AMP essential graphs. Because the well-protected 
configurations (v), (vi), (vii) and (viii) in Definition 4.3 involve strong lines, 
the local characterization of the arrows of an AMP essential graph Q* given 
in Proposition 4.3 in turn requires a characterization of the strong lines of 
Q* . By Lemma 3.3, any line in a chordless undirected cycle or biflag must 
be strong, but Q* may contain other strong lines as well (see [5, 6]). Because 
[Proposition 4.1(b)] the strong chain components of Q* are distinguished 
from the weak chain components by the presence of at least one chordless 
cycle or biflag and the latter involves at least one arrow, the strong lines 
cannot be determined in an intrinsic way. A characterization (necessarily 
nonintrinsic) of the strong chain components of Q* is contained in the char- 
acterization of AMP essential graphs given in Theorem 5.1. 

Some additional terminology is required. Let 67 = (V,E) be an adicyclic 
graph. For any nonempty subset a C V, a vertex v £ a is called a covering 
neighbor (covering parent) of a if v is a neighbor (parent) of each a G a, 
while v ^ a is called a noncovering neighbor (noncovering parent) of a if v 
is a neighbor (parent) of at least one a £a but fails to be a neighbor (parent) 
of at least one other a' G a. The set of covering neighbors (covering parents) 
of a is denoted by cnbc(a) [cpag(a)]. The set of noncovering neighbors 
of a is denoted by ncnbc(a). Note that nbg(a) = cnbc(o;) Uncnbc^a;) and 
cnb(3(cnbG(a)) 2 oi. If a = {a} is a singleton, then trivially ncnbc(a) = 0. 

Lemma 5.1. Let G = (V,E) be a chain graph, £ G S(G) a nontrivial 
chain component, and £ = c1g(£) = £Upa G (£). The following two properties 
of 67| are equivalent: 

S: For every nonempty complete subset a C £ in such that k = cnb(5 5 (o;) 
is nonempty, let K\, . . . , K r denote the connected components of G K . Then 
for each q = 1, . . . , r, either: 

(i) nb Gi (K q )\a^ 0, or 

(ii) pa G _(a) \ cpa G _(K,j) ^ (equivalently, G^ contains a flag t — > 
u — v with t G V \ u£a, and v G K q ). 

S': For every nonempty connected subset kC^ such that a = cnbc^^) is 
nonempty and complete, either: 

(i') ncnb Ge (k) ^ 0, or 
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(ii') pa G _(a) \ cpa G _(K) 7^ (equivalently, G^ contains a flag t — > 
v — w with v E a and w 6 k). 

Proof. S ==> S': Assume that satisfies S and let k C £ be a nonempty 
connected subset in G^ s.t. a = cnb^^ (k) is nonempty and complete. Then 
k' = cnbc ? (Q) ^ k is nonempty, so by S, either (i) labeling) \ a ^ or 
(ii) pa G _(a) \ cpa G _(K 9 ) 7^ 0, where k' q is the unique connected compo- 
nent of G K > that contains k. If k' q = k, then either nbc^^) \a/0 or 
pa G _(a) \ cpa G _(K) 7^ 0, so (i') or (ii') holds. If c € k 9 D k, let 7r = (c = 
Co, ci, . . . , q) be a minimal-length path from c to k in G K > . Then q_i € 
nbG ? (^) n k' 9 C nb(7 e (K) \ a = ncnbc 5 (K), so (i') holds. Thus, S' holds in ei- 
ther case. 

S' ==>■ S: Assume that satisfies S' and let a C £ be a nonempty com- 
plete subset in s.t. k = cnbc 5 (a) is nonempty. Let k±, . . . ,K r denote the 
connected components of G K , fix q E {1, . . . ,r}, and let a' = cnbc c (K g ) D 
a 7^ 0. If nbc c (Kq) \a/0, then (i) holds, so assume that nbc 5 (K g ) \ a = 0. 
In this case a' = a, so a' is nonempty and complete, hence S implies that 
either (i') ncnbc 5 (K g ) / or (ii') pa G _(a') \ cpa G _(K g ) 7^ 0. If (i'), then 

nbc 5 (Kg) \ q = ncnbc ? (k 9 ) 7^ so (i) holds, while if (ii'), then (ii) is imme- 
diate, so S holds in either case. □ 

Lemma 5.2. Let a be a strong chain component of the AMP essential 
graph Q* and let a = c\g* (a) = a U pag* (a) . Then Q% satisfies S = S'. 

Proof. To show that Q% satisfies S, let a C a be a complete subset of Q* 
such that k = cnbg* (a) 7^ and let m,. .. ,K r be the connected components 
of Q*. For any q = 1, . . . ,r, let iJ be the graph obtained from £/* by replacing 
the lines a — c by a — > c for every (a,c) E a x K q . This cannot create any 
immoralities in H since a is complete. If p&g* (a) \cpag* (k,j) = 0, this would 
not destroy any triplexes in Q* . (Note that such a destroyed triplex must be 
a flag in Q* , since no arrows of Q* are altered.) If nbg* (n q ) \ a = 0, neither 
would any flags or semi-directed cycles be created in H. Thus, H would have 
the same skeleton and triplexes as Q* , so H 6 £/. But H a contains at least 
one arrow, so this contradicts the assumption that a is strong. □ 

We are ready to present a complete characterization of general AMP chain 
graphs. The following definitions are needed. 

Definition 5.1. Let G = (V,E) be a chain graph and let E S (G) denote 
the set of nontrivial chain components £ of G such that G| contains at least 
one chordless undirected cycle or flag. Call a line a — b E G strong in G 
(indicated as a - b E G) if a,b E £ for some £ E E S (G). Let H t (G) denote 
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the set of trivial (= singleton) chain components of G, set E W (G) = S(G) \ 
(H S (G7) U E t (G)), and call a line a — b G G weak in G (indicated as a - b G G) 
if a,b G £ for some £ £ Thus, for each ^ € contains no 

chordless undirected cycle or flag. 

Definition 5.2. An arrow a — > 6 G G is weZ/ protected in G if it occurs 
in at least one of the eight configurations in Figure 6 as an induced subgraph 
of 67, where — is now defined as in Definition 5.1. 

By Proposition 4.1(b), these definitions of strong/weak lines in G and 
well-protected arrows in G agree with the previous definitions when G = G* 
is an AMP essential graph. 

Theorem 5.1. A graph G= (V,E) is an AMP essential graph, that is, 
G = Q* for some AMP Markov equivalence class Q , if and only if G satisfies 
the following three conditions: 

Gl: G is a chain graph, that is, is adicyclic. 

G2: For each £ G E S (G), G^ satisfies property S = S'. 

G3: Each arrow in G is well protected in G. 

Proof. "Only if" : If G = Q* is an AMP essential graph, Gl follows from 
Theorem 3.2, G2 follows from Proposition 4.1(b) and Lemma 5.2, and G3 
follows from Proposition 4.3. 

"If": Assume that G satisfies Gl, G2 and G3. Let Q be the AMP Markov 
equivalence class containing G. To show that G = G* , it suffices to establish 
the stronger fact that: 

(a) if a - b G G, then a-beG*; 

(b) if a-beG, then a-beG*; 

(c) if a -> b G G, then a^beG*. 

(a) : It suffices to show that 3 H,H' G G such that a — > b G H and a <— 
b G H' . Since a-b^G, a, b G £ for some £ G E W (G). Since G^ is chordal, use 
MCS starting at a (resp., b) to obtain a perfect orientation of G^, thereby 
replacing 6? by a graph H (resp., H') with a->6€ff (resp., a <— b G H'). 
Since G^ has no flags, it is straightforward to show that H and H' are 
adicyclic and have the same triplexes as G, as required. 

(b) : It suffices to show that, for every £ G H S (G) and every H & G, has 
no arrows. Suppose to the contrary that has at least one arrow. (Note 
that must be adicyclic since H is adicyclic.) Choose a—>bd so that b 
is maximal w.r.t. the pre-ordering induced on £ by H^, that is, there exists 
no semi-directed path in beginning at b. Let £(6) G S(ff^) be the unique 
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chain component of (possibly trivial) containing b and let a = nb^ (£(&))■ 
Note that a G a since a — b G G^. For any a' € a, a' — b' G Gg for some 
b' G £(£>), so a' ■ ■ - b' G flg. If a' 7^ a, then, by the maximality of 6 and the 
connectedness of £ (6) , a' =>■ 6' G -f/g , so by the definition of £ (6) , a' — > 6' G -ffg . 
If a' = a, then a'^&G -ff^. Thus, for every a' € a, a' — > 6" 6 .ffg for all 
6" G £(&) since £(6) is connected and -ffg can have no flags (because G^ has 
no arrows, hence no triplexes). Thus, a = cnbc^ (£(&)), which in turn implies 
that a is complete, since can have no immoralities. Therefore, since G^ 
satisfies property S' by G2, either ncnbc ? (£(&)) 7^ or pa G (a) \cpa G (£(6)) 7^ 
0. The former is impossible since ncnbc c (£(&)) = nbc^ (£(£>)) \cnbc ? (£(&)) = 
a \ a = 0. If the latter holds, then 3 v G V \ £, a' G a, and £/ G such that 
v->o'£G but «•/• 6' in G. But necessarily a' — b' G G^, while a' — > 6' G -f/g, 
so t> — > a' — &' occurs as a flag in G but not in H, also a contradiction, 
(c): It suffices to show that 

A = {a'e V\3b' eV3a'^b'eG,a'-b'eg*} = 0. 

If A 7^ 0, let a be a minimal element of j4 with respect to the pre-ordering 
induced on V by G. Since a&A, 

B={b' G F |o -> 6' G G, a - 6' G G*} ± 0. 

Let 6 be a minimal element of B; in particular, a — ► 6 G G and a — b £ G* . 
By G3, o — > 6 is well protected in G, so it occurs in at least one of the eight 
configurations (i)-(viii) in Figure 6 as an induced subgraph of G. 

(i) If c — > a — > 6 occurs as an induced subgraph in G, then by the mini- 
mality of a the flag c^> a — b must occur in Q* , contradicting the fact that 
G and Q* have the same triplexes. 

(ii) If a — > b <— c occurs as an induced subgraph in G, then the flag a — b^ 

c must occur in Q* , which would require that a - b G G* , hence a — b G G, 
again a contradiction. 

(iii) If a — > 6 <— c ^ a occurs as a triangle in G, then, by the minimality 
of b, the semi-directed triangle a — b <= c <— a must occur in G* , contradicting 
the adicyclicity of Q* . 

(iv) If a — > b occurs in configuration (iv) in G, denote the immorality in 
this configuration by c — > b <— d. Since G and G* have the same triplexes, 
either c^b-^ d or c=?b<^ d occurs as an induced subgraph of G* ■ Without 
loss of generality, assume the former. Since a — b G G* , necessarily c — > a G G* 
by the adicyclicity of G* , hence a — ► d G G* since G and £?* have the same 
triplexes. But then the semi-directed triangle a — > d =>■ b — a occurs in G* , 
again contradicting adicyclicity. 

(v) , (vi), (vii), (viii): If a — ► b occurs in configuration (v), (vi), (vii) or (viii) 
in G, by (b) the strong line in this configuration must also be strong in G* ■ 
Since a — b G G* , Lemma 4.1(d) implies that a - b G G* , which contradicts 
a — ► b G G. This completes the proof of (c). □ 



MARKOV EQUIVALENCE FOR AMP CHAIN GRAPHS 



33 



The necessity of Condition G2 is demonstrated by the graph G in Figure 2 
and the upper graph in Figure 1. The necessity of G3 is demonstrated 
by the graph consisting of a single arrow. 

For comparison with Theorem 5.1, the characterization of ADG essential 
graphs in Theorem 4.1 of [3] can be stated as follows: G is an ADG essential 
graph iff it satisfies conditions Gl, G2': S S (G) = and G3. 

More detailed results on the structure of a strong chain component a 
of Q* = (V, E*) can be obtained from Theorem 5.1. For example, if Q* is 
a strong connected undirected AMP essential graph (so a = V), then by 
Proposition 4.1(b), Q* must contain at least one chordless cycle. Using The- 
orem 5.1, however, it can be shown that unless Q* consists exactly of a single 
chordless cycle, it must contain at least one additional chordless cycle. For 
a general AMP essential graph Q* , by Proposition 4.1(b), Q% must contain 
either a chordless undirected cycle or a biflag. Using Theorem 5.1, however, 
it can be shown that Q% must contain another chordless undirected cycle or 
biflag or "3-halfbiflag." These results appear in [5, 6]. 

6. Current research. Like the essential graph D* for ADG Markov mod- 
els, the AMP essential graph Q* plays a fundamental role for inference, 
model selection and model averaging for AMP CG Markov models. For these 
purposes, the results of [3] and [21] can be extended to AMP CG models 
by means of our characterization of AMP essential graphs in Theorem 5.1 
above. In particular, a polynomial-time algorithm for constructing Q* from 
any G € Q has been obtained — see [5] , Chapter 7. 

The following additional topics are currently under development: 

1. The computational complexity of the above construction algorithm. 

2. An algorithm for recovering all G £ Q from Q* . 

3. Markov chain Monte Carlo algorithms for model search over the space of 
AMP Markov equivalence classes by means of AMP essential graphs. 

4. A catalog of AMP essential graphs with small vertex sets. 

5. Determination of the ratio r n of the number of AMP CG Markov equiv- 
alence classes to the total number of CGs with n vertices (cf. [16] for the 
corresponding question for ADG models). 

6. When is an AMP CG Markov equivalent to some LWF CG, and vice 
versa? (Cf. [4], Theorem 6.) 
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